HiDeNN-TD: Reduced-order hierarchical deep learning neural networks

نویسندگان

چکیده

This paper presents a tensor decomposition (TD) based reduced-order model of the hierarchical deep-learning neural networks (HiDeNN). The proposed HiDeNN-TD method keeps advantages both HiDeNN and TD methods. automatic mesh adaptivity makes more accurate than finite element (FEM) conventional proper generalized (PGD) TD, using fraction FEM degrees freedom. work focuses on theoretical foundation method. Hence, accuracy convergence have been studied theoretically numerically, with comparison to different methods, including FEM, PGD, Deep Neural Networks. In addition, we shown that PGD/TD converges at increasing modes, solution error is summation discretization mode reduction error. shows high orders magnitude fewer freedom hence potential achieve fast computations level for large-size engineering scientific problems. As trade-off between efficiency, propose highly efficient strategy called HiDeNN-PGD. Although less HiDeNN-TD, HiDeNN-PGD still provides higher only small amount additional cost PGD.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning hierarchical categories in deep neural networks

A wide array of psychology experiments have revealed remarkable regularities in the developmental time course of human cognition. For example, infants generally acquire broad categorical distinctions (i.e., plant/animal) before finer-scale distinctions (i.e., dog/cat), often exhibiting rapid, or stage-like transitions. What are the theoretical principles underlying the ability of neuronal netwo...

متن کامل

Learning hierarchical category structure in deep neural networks

Psychological experiments have revealed remarkable regularities in the developmental time course of cognition. Infants generally acquire broad categorical distinctions (i.e., plant/animal) before finer ones (i.e., bird/fish), and periods of little change are often punctuated by stage-like transitions. This pattern of progressive differentiation has also been seen in neural network models as the...

متن کامل

High-order Deep Neural Networks for Learning Multi-Modal Representations

In multi-modal learning, data consists of multiple modalities, which need to be represented jointly to capture the real-world ’concept’ that the data corresponds to (Srivastava & Salakhutdinov, 2012). However, it is not easy to obtain the joint representations reflecting the structure of multi-modal data with machine learning algorithms, especially with conventional neural networks. This is bec...

متن کامل

Hierarchical Cloth Simulation using Deep Neural Networks

Fast and reliable physically-based simulation techniques are essential for providing flexible visual effects for computer graphics content. In this paper, we propose a fast and reliable hierarchical cloth simulation method, which combines conventional physically-based simulation with deep neural networks (DNN). Simulations of the coarsest level of the hierarchical model are calculated using con...

متن کامل

Online Deep Learning: Learning Deep Neural Networks on the Fly

Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch learning setting, which requires the entire training data to be made available prior to the learning task. This is not scalable for many real-world scenarios where new data arrives sequentially in a stream form. We aim to address an open challenge of “Online Deep Learning” (ODL) for learning DNNs on the fly in an on...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computer Methods in Applied Mechanics and Engineering

سال: 2022

ISSN: ['0045-7825', '1879-2138']

DOI: https://doi.org/10.1016/j.cma.2021.114414